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(54) Method and apparatus for image processing 

(57) A first feature parameter calculating circuit out- 
puts, as a variable of a first feature parameter, a differ- 
ence between a maximum value and a minimum value 
of signal levels of pixels calculated in a local block hav- 
ing a target pixel at a center. A second feature parame- 
ter calculating circuit determines sums of differences in 
signal level in the local block, along a direction in which 
the pixels^are arranged, and outputs, as a variable of a 
second feature parameter, a minimum value of the 
sums. A third feature parameter calculating circuit bina- 
ries the pixels in the local block, and counts the 



number of succeedingly arranged pixels having equal 
density, for example, along a main .scanning direction, 
and calculates a difference between a maximum value 
and a minimum value of the numbers counted. In the 
same manner, a difference is also calculated along a 
sub scanning direction, and larger of two differences is 
outputted as a variable of a third feature parameter. A 
judging circuit categorizes each variable rnufti-dimen- 
sionally so as to discriminate a region incfuding the tar- 
get pixel. 
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Description 



FIELD OF THE INVENTION 



[0001] The present invention relates to an image processing apparatus for judging a feature of each pixel for use in 

USS'JS^lSS! ""F ma 2 ine " ld 3 faCSimi ' e WhiCh pr ° CeSSeS an imaae ^nal representing a 

plurality of pixels, and to a recording medium recording a program for such a process. 
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BACKGROUND OF THE INVENTION 



a^L^T^Z^ " " d y tf ""I « « digita l copying machine and a facsimile processes 

a document composed of a character reg.on. a photographic region, or a halftone dot region, or a document composed 
of a mixture lof such regions. The image processing apparatus reads a d«:umem induding such regi^sTr»Sae 
VSS "?T CCD (Char9e ^"P' 65 DeVice) - and the document thus read h£> an irna^g™? 9 

i ' ! image P rocessin 9 apparatus carries out image processing so as to improve the image quality of 

a receded image obtained from the image signal. For example, when the image is characters, an enharoemenTp^- 
ess is carried out to enhance the edges of the image, and when the image is halftone dots, a smoothing process is car- 
OU * 80 * s to Drevent moire - Mso - ""en the image is characters, it is a common practice to carry out a process for 
converting the image into a character code. K 
[0004] In either process, it is often the case that an appropriate image process differs for each of the drfferent types 
of an images and in order to improve the image quality pf the recorded image, the image process needs to be carried 
out in accordance with the type of the image. 

I!!!!! • 8 """"""""J *ec""^ue for improving the image quality using a filtering process, for example, the image 
processing apparatus as disclosed in Japanese Examined Patent publication No. 21384/1993 (Tokukohei 5-21384) is 
available. In this image processing apparatus, an image signal which has been smoothed and an image signal which 
sTasTbeou* uStT """^ W * OUlput 0f tne imafle sianal from ^ component detecting means 

Sfi/lS^S^ ^ iCe aSdisClosed in Ja « sanese Unexamined Patent publication No. 

fn™f rrokukaisho 63-246076). when the edge component of the image signal is not extracted by edge extract- 
ion ha " been ****** to a fmerina P rocess ft* moving a halftone dot component is selected. 
t££? u component .s extracted, a signal which Jias not been subjected to a filtering process is selected 

^T"- d,scr ' m,na « on ^ imaQe ^ detection of the edge component alone is not sufficient and there 
Linn ?J?I dlSCT,m,na,,n 9. 106 imaae be,on 9 to a character region, a photographic region, or a halftone dot 

region, and to carry out an image process in accordance with the result of discrimination 

an ima 9 e discrimination method for improving the image quality in the described manner, a method in which 
an image is segmented into blocks, each composed of a plurality of pixels, so as to discriminate image types perTJch 
^S^*" W ' dely - H ! fe ' Wh6n ima9e are t0 be disCTi ™ated per each block by pattern matching, 

l^Lnri ^7L aTe ^r 396 * e3Ch bl0Ck With one * is re " uired to P r *Pa'« a large number of patterns 

prSral ap^tiJS" ""^^ St ° ,in9 me 'P a,l » rn » is increased, and this method is not suitable for 

^HHL* H^' in * eS ll ayS ' * has been a common P ractice to acto Pt a method in which feature parameters are 
uZ1T2Z2 ^ °^ ^ a P redetermined Procedure and image types are discriminated in accordance with the tea- 
ture parameters thus extracted. 

l ° mC L J? exampie - in tne halftor,e dot-photographic region discrimination method as disclosed in Japanese Unex- 
kT ! P"W.cation No. 194968/1986 (Tokukaisho 61-194968). in a certain block, a change in signal level 
ivST? ^ s " < 2 eedin 9 P ,xel5 in 8 ^ scanning direction is measured, and the sum of measured values in the block 
is calculated. In the same manner, the sum of the change in signal level is also calculated with respect to a sub scan- 
r«^ eC f °"' !" mS il ° f meaSured va,ues in scannina direction and in the sub scanning direction are 

«. SEET^ C ° mpa . red wrtn a Predetermined set value, and the image type of each block is discriminated in accordance 

so witn the result of this comparison. 

!K!Lt^?^ meth0d m ** B * in * ,eature Parameters, for example. Japanese Unexamined Patent publication No 
147860/1987 (Tokukaisho 62-147860) discloses a half-tone facsimile signal processing method. In this method a dif- 
ference between a maximum signal level and a minimum signal level of a certain block are determined and the'differ- 

55 value, since the block is a portion in which a change in signal level is gradual in this case, the block is judged to be a 
photographjc region. On the other hand, when the difference is larger tan the first set value, since the block is a portion 

L,r~ h * an9 !."! I 9 "* le " e ' fe Hbrup1 " thiS CaSe> 106 btock is iudged to indude a <* characters and pic- 

tures, or halftone dot-photographic portion. 
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[001 2] Also, in this method, it is judged whether there is a change in signal level between two pixels succeeding spe- 
cially in a block in accordance with an access order which has been set beforehand so as to calculate the number of 
changes. The number of changes thus calculated is compared with a second set value which has been set beforehand, 
and when the number of changes is larger than the second set value, the block is judged to be a halftone dot region' 
On the other hand, when the number of changes is smaller than the second set value, the block is judged to be a region 
other than the halftone dot region. The image type of each block is judged in accordance with the judgement based on 
the level difference and the judgement based on the number of changes. 

[0013] However, in the conventional image discrimination methods as described above, the discrimination accuracy 
is not sufficient, and misjudgment of image type is likely to occur. Thus, in order to realize higher image quality, further 
improvement in the discrimination accuracy is needed. 

[00t*l Here, the luweiing of discrimination accuracy Is caused generaily by unmatching o» feature parameters, 
namely, the characteristics of the character region, the photographic region, and the halftone dot region are not suffi- 
ciently represented by feature parameters. Also, misjudgment is induced by the following important factors of (a) a 
method for categorizing image types based on feature parameters is inappropriate and (b) the threshold values (set val- 
ues mentioned above) for categorizing image types are not selected appropriately. 

[001 5] Specifically, in the described prior art. a predetermined threshold value is set for each of the feature parame- 
ters. Also, each of the feature parameters and each threshold value are individually compared, and after carrying out 
judgement per feature parameter, the blocks including pixels are categorized in accordance with the result of each 
judgement. For this reason, ft is difficult to set an appropriate threshold value for each feature parameter, and even 
when the number of feature parameters is increased, it is difficult to obtain sufficient discrimination accuracy. 
[001 6] Also, in the described prior art, the type of region is judged per each block. Therefore, when the region type is 
misjudged, the entire pixels of the block are affected, and the image quality is greatly lowered. Furthermore, because 
the feature parameters of the target pixel reflect only limited image processing characteristics, an optimum image proc- 
ess cannot be carried out in accordance with each target pixel. 

[0017] As a courttermeasure against these problems. Japanese Unexamined Patent publication No. 125857/1996 
(Tokukaihei 8-1 25857) discloses an image processing apparatus in which the region type of a block is judged in accord- 
ance with a combination of plural feature parameters, and the region type of surrounding blocks are judged per each 
pixel. This prevents the discrimination accuracy from being lowered by inappropriate selection of the threshold values 
and inappropriate categorizing method. 

[0018] However, even in an image processing apparatus having this arrangement the characteristic of each region 
type is not fully represented by the feature parameters, and further improvement in discrimination accuracy is needed. 

SUMMARY OF THE INVENTION 

[001 9] The present invention offers a solution to the above-mentioned problems, and accordingly it is an object of the 
present invention to provide an image processing apparatus capable of discriminating a character region, a photo- 
graphic region, and a halftone dot region of an image with certainty, and a recording medium recording a program for 
image processing. 

[0020] An image processing apparatus in accordance with the present invention has an arrangement including: 

(1) a main direction calculating section for calculating a first line maximum value, per main line along a predeter- 
mined main direction, with respect to a binary image prepared by binarizing with a predetermined threshold value 
image data of a local block composed of a target pixel, which is one of pixels constituting an image, and a plurality 
of pixels surrounding the target pixel, the first line maximum value being a largest number of succeedingly arranged 
pixels having an equal value in the predetermined main direction in the local block so as to determine a difference 
between a main maximum value which is the largest first line maximum value and a main minimum value which is 
the smallest first line maximum value; 

(2) a sub direction calculating section for calculating a second line maximum value, per sub line along a sub direc- 
tion different from the main direction, with respect to the binary image, the second line maximum value being a larg- 
est number of succeedingly arranged pixels having an equal value in the sub direction so as to determine a 
difference between a sub maximum value which is the largest second line maximum value and a sub minimum 
value which is the smallest second line maximum value; 

(3) an output section for outputting. as a variable of a succession feature parameter, larger of differences respec- 
tively outputted from the main direction calculating section and the sub direction calculating section: and 

(4) discriminating means Jor outputting region discrimination information for discriminating that the target pixel 
exists in which region of different image types including the character region and the halftone dot region in accord- 
ance with an output of the output section. 
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taSSSjJ? 11 88 b6en Prop ° sed conventiona "y to ^culate. as a feature parameter represent- 

ing he feature of the region of different image types, a difference between a maximum signal level and a minimum sig- 
nai level of pixels '"a certain block and the number of times the signal levels of the pixels change between binary 
SS^T^T th ! 1 5 ature P*? metar <***ned in this manner, it is difficult to discriminate a coarse halftone dot 
reg.on. that is a halftone dot region wrth a small number of lines, from a character region, especially a character region 
composed of fine characters. Here, 'lines" refers to a series of halftone dots or characters 

SS JSi a T ra ,ll in the halfl ° ne d0t re9i0n> Compared ^ the character re 9 ion - difference between the 

!^J^h k^k I tendenC 'f become more P rominent - » become more difficult to distinguish the halftone dot 
Ti,^ ■ , re9,0n fr ° m 6aCh other Howwer - as the <* "nes in the halftone dot region decreases, 

^ ^J^ 0 " Ial " >e dm6rence between the "a* 1 ™" signal level and the minimum signal level is 
S^i, T?T rt Chan9eS in Si9nal l8vel is reduced ' is to say. when only the feature parameter as 
obtained in the described manner is used, the discrimination accuracy for the halftone dot region with a small number 
of lines and the character region is lowered. 

[0023] In contrast, in the image processing apparatus in accordance with the present invention, the succession fea- 
1 Jl i0 T a,,y ca,cu,ated 35 a ,eature Parameter representing the feature of the region of different image 
rrS? ! P l eS 4 ! m inventionhave »** in the halftone dot region, due to the arrangement and the 
P £ °Jf** °* the halftone dots, the mam maximum value or the sub maximum value obtained in each line is smaller than 
a , "J * the chM «* r W- and the main minimum value or the sub minimum value is larger than that of the character 

2u ■ rGQIOn. 

^llrJ^' Whe " th6 Buccession feature Parameter calculated in accordance with the difference of the maximum 
value and the m.n.mum value is determined with respect to each of the halftone dot region and the character region 
the succession feature parameter of the halftone dot region becomes clearly smaller compared with the succesac-nfea- 

^ r^r^'f C ,^ ra l er ^ 3 reSUlt Wlth the succession ,eatur * Parameter, it is ensured that the halfton e 
dot region with a small number of hnes and the character region, particularly, the character region composed of fine 
mr^?^ are d,£cr,m,nated ' ^ greatly improving the discrimination accuracy of the image processing apparatus 
[0025J The image processing as described above having such a desirable characteristic is carried out by execution 
ot a program recorded on a recording medium as described below. 

S^tioITw ^f^^*-"*^ recording medium recording a program which calculates region discrimination 
£ Zn ° ? d *f ,m,nat,n 9 a target pixel, which is one of pixels (instituting an image, exists in which of regions 
eluding a character reg.on and a halftone dot region, the computer-readable recording medium recording a program 
for carrying out image processing which includes the steps of: h"h« 

(1) calculating a first line maximum value, per main line along a predetermined main direction, with respect to a 
binary .mageprepared by binarizing with a predetermined threshold value image data of a local block composed 
!J? 9 t ^ "5 3 , P,Ura " ty 0f " pixelS S""™"*" 0 - the target pixel, the first line maximum value being a largest 
number of succeeding^ arranged pixels having an equal value in the predetermined main direction in the local 
block so as to determine a difference between a main maximum value which is the largest first line maximum value 
and a main minimum value which is the smallest first line maximum value; 

Sh^'fllP Hne maximum v*" 6 ' sub line alo "9 a sub direction different from the main direction. 

™?Jf? * e ""T* ima9e> ^ second line maximum va lue being a largest number of succeedingly arranged 
T t ^ a " • qMBl V3lUe the SUb direction 50 as to determine a difference between a sub maximum value 
which is the largest second line maximum value and a sub minimum value which is the smallest second line max- 
imum value; 

S ^Ii^tf 8 ?. Vari f b, !o C f SUCCeSSl0nfeature ^ameter, larger of differences respectively determined in 
the step (1) and in the step (2); and 

(4) generating the region discrimination information in accordance with the succession feature parameter. 

^ 38 !?1 9 3 l the IOCal W0Ck iS com P° sed <* a *V* P ixel ^d pixels surrounding the target pixel, it is 
n<*necessanl> r required that the target pixel is located at the center of the local block. Neve^^ 

loSf'lT " a ^ Uf !^ * iS deSiraWe *• ,ocal Wock fe set each pixel so that the target pie! is 
located at the center of the local block. 

ES2L H F £i!i? er understandin 9 of the nature and advantages of the invention, reference should be made to the 
ensuing detailed description taken in conjunction with the accompanying drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
[0029] 

Fig 1 is a block diagram showing main components of an image processing apparatus in accordance with one 
embodiment of the present invention. 

Rg^2 is an explanatory drawing showing an example of a feature parameter distribution on axes of first through 
third feature parameters. 

Fig. 3 is a two-dimensional projection which is a projection of the feature parameter distribution of Fig. 2 onto a 
plane with axes of the first and second feature parameters. 

A te a two d i m e ns i ona l pro je ct i on whi c h is a pro jec tion of th e f ea t u r e pa r ame t er distribution of ha. 2 onto a ' 

plane with axes of the first and third feature parameters. 

Fig. 5 is a two-dimensional projection which is a projection of the feature parameter distribution of Fig 2 onto a 
plane with axes of the second and third feature parameters. 
Fig. 6 is a flowchart showing an operation of the image processing apparatus. 

Fig. 7 is an explanatory drawing showing one example of a judging circuit of the image processing apparatus 
Fig. 8 is an explanatory drawing showing a neural network used in the judging circuit. 

Sa^^us^^" 0 * 0 ^ draWin9 showin9 an in Pu*-<>utPut relationship of neural elements of the image processing 
Fig- 1 0 is an explanatory drawing showing another example of the judgir cuit of the image processing appara- 

Figj 1 is a block diagram showing main components of an image processing apparatus in accordance with another 
embodiment of the present invention. 

Fig. 12 is a block diagram showing main components of an image processing apparatus in accordance with still 
25 another embodiment of the present invention. 

Fig. 13 is a flowchart showing an operation of the image processing apparatus. 

Fig. 14 is an explanatory drawing showing one example of filter coefficients used in a tittering process rircuit when 
carrying out an enhancement process in the image processing apparatus. 

Fig. 15 is an explanatory drawing showing one example of filter coefficients used in the filtering process circuit 
when carrying out a smoothing process in the image processing apparatus. 

Fig. 16 is an explanatory drawing showing one example of filter coefficients used in the filtering process circuit 
when carrying out a combination of enhancement and smoothing processes in the image processing apparatus. 

DESCRIPTION OF THE EMBODIMENTS 
[First Embodiment] 

[0030] The following will describe one embodiment of the present invention referring to Fig. 1 through Fig. 10 
[0031 ] Namely, an image processing apparatus in accordance with the present embodiment judges that a target pixel 
exists in which of a character region, photographic region, and a halftone dot region. For this purpose, the image 
processing apparatus includes, as shown in Fig. 1 . (i) an input terminal 1 from which an image signal is inputted (ii) a 
? '^^l™^ 2 for St ° rin9 inforrnation P ixel in a vi cinity of the target pixel in accordance with the image signal 

(ui)f irst through third feature parameter calculating circuits 3. 4. and 5 for calculating respective variables of first through 
third feature parameters P t through P 3 . respectively, in accordance with the information stored in the block memory 2 
(iv) a judging circuit 6 for judging a region including the target pixel in accordance with respective output values of the 
,™f p *' ameter coating circuits 3. 4. and 5. and (v) an output terminal 7 for outputting the result of judgement. 
[0032] The feature parameter calculating circuits 3, 4. and 5 and the judging circuit 6 may be composed of for exam- 
ple, a combination of logical circuits and calculation circuits, or may be realized by execution of a predetermined pro- 
gram by a CPU (Central Processing Unit). 

[0033] Note that, the first feature parameter calculating circuit 3 corresponds to a maximum density difference feature 
parameter calculating means of the claims, and the second and third feature parameter calculating circuits 4 and 5 cor- 
respond to complexity feature parameter calculating means and succession feature parameter calculating means Also 
the judging circuit 6 corresponds to discriminating means. The third feature parameter calculating circuit 5 is referred to 
as succession feature parameter calculating means. 

[0034] As the image signal inputted into the input terminal 1 . a variety of image signals are possible However here 
as an example, explanations will be given through the case where the image signal is obtained by reading of ^docu- 
ment by an image reading section (not shown) having a CCD (Charge Coupled Device) image sensor in a digital cop- 
ying machine or a facsimile device. 
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[0035] The CCD image sensor converts light intensity into an electric signal, and is capable of converting density of 
at least one pixel into an image signal. The image reading section, when reading a document moves the CCD imaae 
sensor in one direction (referred to as a main scanning direction hereinafter) so as to obtain an image signal of a sinole 
line or of plural lines of a document. Note that, the number of lines which can be obtained by single scanning of the 
image reading section in the main scanning direction is determined by the number of pixels which the CCD image sen- 
sor is capable of reading at a time. ewwu/iiwyeMsn 

!mL T I , nH C ™T e ! enSOr "V?" mo ? d in 3 d '' reCti0n (SUb scanning direction > orthogonal to the main scanning 
auction and scans the document for one line or plural lines. By repeating this process, the image reading section 
obtains an image signal of the entire document. Note that, the image signal can take any form provided that the signal 

ffSSl '^^^^.n^'fc^!" 9 , 3 , plu ? li1y ** density levels are a"a"ged two-dimensionally. 
Ihr^Hii,^?!?? 1 mom l °, ry 2 j&*"^W«J «iU. a ...*... u .y .egiw, for storing the image signal ot plural lines, inputted 

X? SnEI , V leVelS (8 bitS) for Pixel " ^ the *"* memor * 2 image sig- 

TJH ^ ^ ° f * tar9et Ptal 8nd 8 P ' ura,ity 01 pixels ^Tounding the target pixel. Note that, when the 

number of pixels .n the sub scanning direction, which ttie CCD image sensor can obtain by single scanning in the main 
scanning direction, does not reach the number of pixels in the sub scanning direction in the local block, for example 
.mage signals obtained by plural scanning in the main scanning direction are accumulated. This allows the image signal 
ot tne entire local block to be stored. • 
[0038] The first feature parameter calculating circuit 3 includes a maximum value detecting circuit 31 for calculating 
a maximum agnat level (Amax) in the local block in accordance with the image signal stored in the block memory 2 a 
minimum value detecting circuit 32 for calculating a minimum signal level (Amin) in the local block in accordance with 
theimage signal, and a subtracter 33 for subtracting the output value of the minimum value detecting circuit 32 from the 
output value of the maximum value detecting circuit 31. Thus, the first feature parameter calculating circuit 3 outputs 

and the minimum signal level (Amin). v ' 

25 [0039] The second feature parameter calculating circuit 4 includes a main scanning direction difference value sum 
calculating circuit (referred to as main difference value calculating circuit hereinafter) 41a and a sub scanning direction 
difference value sum calculating circuit (referred to as sub difference value calculating circuit hereinafter) 41b for 

S^TiTr Va ' Ue ( ? b6tWeen ^ SUCceecfin9 w succeedingly arranged pixels in the main scan- 
ning direction and in the sub scanning direction, respectively, in accordance with the image signal stored in the block 
m T? y \ a ™l a comparator 42 for comparing respective outputs of the main difference value calculating circuit 41a 
and the sub difference value calculating circuit 41b. 

I 0 ! 401 ^ 1 ^ 6 "^P difference value calculating circuit 41a. referring to the block memory 2. in the local block, sequen- 
'n V £? drffef r Ce value (C > between «"° needing pixels in the main scanning direction. As a resuR the sum 
(D of drfference values (C) in the main scanning direction in the local block is calculated. Similarly, the sub difference 

?H- 1 ^? pa, !! 0r 42 OUtpUtS a minimum va,ue < Frnin > ° f t" e respective outputs of the main difference value cal- 
culating circuit 4la and the sub difference value calculating circuit 41b. Note that, in the case where the number of dif- 
ference values (C) are different in the main scanning direction and in the sub scanning direction/the corroarator 42 
normalizes the drfference values (C) in accordance with the number of difference values (C) in each direction and out- 
puts the minimum value of the sums (D) and (E) of the normalized difference values (C). Thus, the second feature 
parameter calculating circuit 4 outputs, as a variable (second variable) of the second feature parameter P 2 . the rnini- 
fon^n^oSTblocl SUmS (D> (E) * differenCe Values {C) 01 main ^""'"S directfon ^ seaming direc- 
[0042] Further, the third feature parameter calculating circuit 5 in accordance with the present embodiment includes 
a main direction calculating section associated with the main scanning direction and a sub direction calculating section 
associated with the sub direction. The main direction calculating section includes a main scanning direction maximum 
succession equal densrty pixel number maximum value calculating circuit (referred to as main maximum pixel number 
calculating circuit hereinafter) 51a. a main scanning direction maximum succession equal density pixel number mini- 
mum value calculating circuit (referred to as main minimum pixel number calculating circuit hereinafter) 52a. and a sub- 
tractor 53a. The sub direction calculating section includes a sub scanning direction maximum succession equal density 
pixel number maximum value calculating circuit (referred to as sub maximum pixel number calculating circuit hereinaf- 
ter) 51& a sub scanning direction maximum succession equal density pixel number minimum value calculating circuit 
(referred to as sub minimum pixel number calculating circuit hereinafter) 52b. and a subtracter 53b. The third feature 

Pa L! m I! r < ?' cula " n 9 drcuit 5 ,urther Glides a comparator (output section) 54 for comparing respective outputs of the 
subtracters 53a and 53b so as to output larger of two values. 

[0043] The main maximum pixel number calculating circuit 51a. referring to the block memory 2. binarizes each pixel 
in the local block with a predetermined threshold value. The main maximum pixel number calculating circuit 51a also 
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calculates, per main line along the main scanning direction, a maximum value (maximum succession equal density 
pixel number) C1 of the numbers of binarized pixels having equal values in succession. Further, the main maximum 
pixel number calculating circuit 51 a determines a maximum value C3 from the values of the maximum value C1 as cal- 
culated with respect to each main line in the local block. Note that, the number of main lines in the local block is the 

s same as the number of pixels in the sub scanning direction. For example, when the local block has 7x7 pixels, the 
numberof main lines is 7. Also, in the present embodiment, as an example, a maximum succession black pixel number 
is determined by counting the number of succeeding pixels having one of binary values, which indicates black. 
[0044] Similarly, the main minimum pixel number calculating circuit 52a calculates the maximum succession equal 
density pixel number Cl per m&in line in the local block so as to determine a minimum value C4 from the values of C1 . 

io The subtracter 53a outputs a difference of the maximum value C3 and the minimum value C4 as a main scanning direc- 

ti on maximum succ e s s io n eq ua l d e n s it y p i xe l num be r maxi m u m va l ue C5. 

[0045] In the same manner, the sub maximum pixel number calculating circuit 51b associated with the sub scanning 
direction, referring to the block memory 2, binarizes each pixel in the local block with a predetermined threshold value. 
The sub maximum pixel number calculating circuit 51b also calculates the maximum succession equal density pixel 

is number C1 per sub line along the sub scanning direction so as to dtetermine a maximum value C6 from the values of 
C1 as calculated with respect to each sub line in the local block. The sub minimum pixel number calculating circuit 52b 
calculates the maximum succession equal density pixel number C1 per sub line in the local block so as to determine a 
minimum value C7 from the values of C1 . The subtracter 53b outputs a difference of the maximum value C6 and the 
minimum value C7, as a sub scanning direction maximum succession equal density pixel number maximum value C8. 

20 In the following, regardless of the sub line or main line, pixels succeeding or succeedingly arranged in one direction will 
be referred to as a line. 

[0046] Note that the above explanation is given through the case where, as an example, each of the calculating cir- 
cuits 51a, 51b, 52a and 52b itself binarizes the signal level of each pixel referring to the block memory 2. However, not 
limiting to this, it is possible, for example, to generate a binary image from an image signal by other means, and send 

25 the binary image to each of the calculating circuits 51a, 51b, 52a. and 52b. As long as the values of C3. C4, C6, and 
C7 are calculated in accordance with the binary image, the same effect as above can be obtained. 
[0047] The comparator 54 compares the output value C5 of the subtracter 53a and the output value C8 of the sub- 
tractor 53b. and outputs, as a variable (third variable) of the third feature parameter P 3 , larger (maximum value) of the 
two output values C5 and C8 to the judging circuit 6. The variable (first variable) of the first feature parameter P A and 

30 the variable (second variable) of the second feature parameter P 2 respectively outputted from the first feature parame- 
ter calculating circuit 3 and the second feature parameter calculating circuit 4 are also sent to the judging circuit 6. 
[0048] Here, after conducting research, the inventors of the present invention have found that in a three-dimensional 
space having the axes of the first feature parameter , the second feature parameter P 2 , and the third feature param- 
eter P 3 , the feature parameters of the pixels of the character region, the photographic region, and the halftone dot 

35 region are distributed, for example, as shown in Fig. 2. 

[0049] When the feature parameter distribution of Fig. 2 is projected onto a two-ci mensional plane having axes of the 
first feature parameter P-, and the second feature parameter P 2 . the feature parameter distribution takes the form as 
shown in Fig. 3. Similarly, Fig. 4 is a two-dimensional projection of the feature parameter distribution of Fig. 2 onto a 
plane having axes of the first feature parameter P n and the third feature parameter P 3 , and Fig. 5 is a two<iimensional 

to projection of the feature parameter distribution of Fig. 2 onto a plane having axes of the second feature parameter P 2 
and the third feature parameter P 3 . 

[0050] To explain in more detail, in'the threedimensional space, the first and second feature parameters P<\ and P 2 of 
the photographic region are smaller than those of other regions (character region and halftone dot region). However, 
the third feature parameter P 3 of the photographic region has relatively wider distribution compared with those of the 

45 other two regions. Thus, in the three-dimensional space, decision boundaries or decision surfaces for discriminating the 
photographic region from the other regions can be set relatively easily. Note that, in the following, decision boundaries 
and decision surfaces will not be distinguished specifically, and both will be referred to as boundaries. 
[0051 ] On the other hand, it is more difficult to set a boundary for discriminating the character region and the halftone 
dot region from each other compared with the case with the photographic region. Namely, compared with the character 

so region, the halftone dot region is likely to have smaller first feature parameter P n and larger second feature parameter 
P 2 . However, as the number of lines in the halftone dot region decreases, the first feature parameter P 1 becomes larger 
and the second feature parameter P 2 becomes smaller. Thus, as shown in Fig. 3, on a plane having the axes of first 
and second feature parameters and P 2 , the halftone dot region having a small number of lines and the character 
region are adjacent or overlapped with each other, and as a result it is difficult to set a boundary capable of discriminat- 

55 ing the two regions. 

[0052] For example, in Fig. 3, the feature parameter of a region composed of relatively fine 200 line halftone dots is 
distributed on portion A as indicated by the alternate long and short line, and the feature parameter of a region com- 
posed of relatively coarse 85 halftone dots is distributed on portion B as indicated by the broken line. On the other hand, 
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the feature parameter of a region composed of relatively large 20 class characters is distributed on portion C as indi- 
cated by the alternate long and two short lines, and the feature parameter of a region composed of relatively small 7 
class characters is distributed on portion D which overlaps the feature parameter of the region composed of 85 line half- 
tone dots. Thus, when the regions are to be discriminated based solely on the first and second feature parameters P 1 
and P 2 . the coarse halftone dots (85 line halftone dots) and the small characters (7 class characters) cannot be discrim- 
inated against each other. 

[0053] Here, in the halftone dot region, compared with the character region, the arrangement of pixels is constant 
and period.c.ty is likely to appear in the density of pixels. As a result, as shown in Fig. 2. in the distribution of the halftone 
dot region, regardless of the number of lines in the halftone dot region, the third feature parameter P 3 is Okely to be 
small. Thus, as shown in Fig. 3, even when it is difficult to set a boundary capable of discriminating the two regions on 
-^a-plano having the axes of first and second feature pa i ameters P 1 and P 2 . as shown iri Hg. 4 and Fig 5 by providing 
the third feature parameter P 3 , it is ensured that the boundary is set As a result, it is possible to discriminate coarse 
halftone dots such as 85 line halftone dots and small characters such as 7 class characters from each other, thus 
improving the discrimination accuracy of the image processing apparatus. 

[0054] Upon receiving respective variables of the feature parameters P 1§ P 2 , and P 3 of the target pixel from thefeature 
parameter calculating circuits 3. 4, and 5, the judging circuit 6 of the present embodiment carries out the categorizing 
process in the threedimensional space, and outputs region discrimination information in accordance with the feature of 
the region (local block) including the target pixel. 

[0055] The region discrimination information may be a signal, such as a discrimination signal Oa (mentioned later) 
which clearly distinguishes that the region including the target pixel is the character region, the photographic region or 
the halftone dot region, or may be represented by a value, such as an output value Ob (mentioned later), which iridi- 
cates the likelihood that the region including the target pixel is the character region, the photographic region. 6r the half- 
tone dot region. 

[0056] In accordance with the described arrangement, the following describes the flow of the region discriminating 
process of a recorded image referring to the flowchart of Fig. 6. Namely, in Step 1 (Hereinafter. Step will be abbreviated 
to S). when an image obtained by scanning of a document by the image reading section including the CCD image sen- 
sor is inputted to the input terminal 1 of the image processing apparatus of Fig. 1 . the block memory 2 stores the image 
signal of a local block having a target pixel at the center. Then in S2. the first through third feature parameter calculating 
circuits 3. 4, and 5 calculate respective variables of the first through third feature parameters P* , P 2 and Pa of the local 
block, respectively, referring to the block memory 2. 

[0057] The judging circuit 6. in S3, categorizes the feature of the local block in accordance with the variables calcu- 
lated in S2, and in S4. outputs region discrimination information. As a result the region (local block) including the target 
pixel is discriminated to be the character region, the photographic region, or the halftone dot region, namely, it is dis- 
criminated that the target pixel exists in which of the character region, the photographic region, and the halftone dot 
region. The process of S2 through S4 is carried out consecutively with respect to all the pixels included in the image 
signal inputted ifrto the image processing apparatus. 

[0058] Here, as in the conventional arrangement in the case where a block is set beforehand, and regions are dis- 
criminated per block, the feature parameters of pixels of a certain block are reflected only when categorizing thefeature 
parameters of this block. Thus, when a boundary is drawn between adjacent pixels in the block, the feature parameter 
of one of the pixels is not used when discriminating the block including the other pixel. 

[0059] However, in the image processing apparatus in accordance with the present embodiment since the process 
of S2 to S4 is carried out per each pixel, a new local block having a target pixel at the center is set everytime a pixel is 
set to be the target pixel. Thus, compared with the case where a block is set beforehand, the discrimination accuracy 
is improved, and optimum region discrimination information in accordance with each target pixel is generated. As a 
result, with this region discrimination information, it is possible to carry out delicate processes such as optimum image 
processing in accordance with each target pixel. 

[0060] The following describes a specific example of the structure of the judging circuit 6 referring to Fig. 7 through 
Fig. 9. In this example, the judging circuit 6 selects whether the region including the target pixel is the character region, 
the photographic region, or the halftone dot region, namely, a discrimination signal Oa in accordance with each region 
type is outputted as region discrimination information. 

[0061] Here, for example, it is assumed that the local block has a size corrposed of 7 x 7 pixels, and the signal level 
of each pixel is expressed in 256 levels (8 bits). 

[0062] Here, the first feature parameter P, is the difference (B) between the maximum signal level (Amax) and the 
minimum signal level (Amin). and takes a value from 0 to 255. Thus, the first feature parameter P, can be expressed in 
8 bits. In the actual case, the first feature parameter P 1 is saturated with 7 bits of LSB (Least Significant Bits) of 8 bits 
and the lower 7 bits of 8 bits are significant. Also, the lower 2 bits of the lower 7 bits of the first feature parameter P 1 are 
removed, and the remaining 5 bits are inputted as input signals l 00 to l^ to a judging circuit 6a of Fig. 7. 
[0063] The second feature parameter P 2 is the sum (D) of the differences (difference value (C)) in signal level between 
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pixels. Thus, the minimum value of the second feature parameter P 2 is 0. and the maximum value is 10710 (255 x 6 x 
7 = 10710). Thus, the second feature parameter P 2 is expressed in 14 bits. As in the case of the first feature parameter 
Pt . the second feature parameter P 2 is saturated with the lower 1 0 bits of the 1 4 bits, and the lower 4 bits are removed, 
and input signals l 10 to l 15 of 6 bits are inputted into the judging circuit 6a. 

[0064] The third feature parameter P 3 is the difference between the maximum values (C3 and C6) and the minimum 
values (C4 and C7) of the maximum succession equal density pixel number. Thus, the third feature parameter P 3 takes 
a value between 0 and 7. and is expressed as data of 4 bits. The third feature parameter P 3 is saturated with the tower 
3 bits of the 4 bits, and input signals l^ to I22 of 3 bits are inputted into the judging circuit 6a. 

[0065J The judging circuit 6a of Fig. 7 outputs a discrimination signal Oa of 2 bits so that the character region, the 
^ph^ographic region, and the halftone dot regions are discriminated from one another. For example, when the result of 
-judgement s character re gion, the judg i ng c i rcu i t 6a ou t pu ts a disc i h nination va l ue "0" ind icative of a character reg i on. 

as the discrimination signal Oa where Oao 0 = 0 and Oaoi = 0. In the same manner, in the case of the photographic 

region, a discrimination value T (Oaoo = O and Oaoi = 1) is outputted. and in the case of the halftone dot region a 

discrimination value "2" (Oao 0 = 1 and Oa^ = 0) is outputted. 

[0066] The judging circuit 6a is realized by (a) a look-up table whose input-output characteristics are determined 
beforehand by a neural network or (b) a neural network itself. As an example of the neural network used here, as shown 
in Fig. 8, a four-layer perceptron is available. In an input layer of a neural network 61. h receives a value obtained by 
normalizing the first feature parameter P v In the same manner, l 2 and l 3 respectively receive values obtained by nor- 
malizing the second feature parameter P 2 and the third feature parameter P 3 . respectively. In an output layer of the neu- 
ral network 61, O c outputs a value indicative of the likelihood of the character region. O p outputs a value indicative of 
the likelihood of the photographic region, and O s outputs a value indicative of the likelihood of the halftone dot region. 
Each input of the input layer is connected to all neural element inputs of an intermediate layer, and each output of the 
intermediate layer is connected to all neural element inputs of the output layer. 

[0067] As shown in Fig. 9. each neural element has multiple inputs and a single output. When the input value to each 
neural element is x h each weight coefficient is w fj . and the output value is Vj. each neural element calculates the sum of 
products in accordance with Equation (1). and the result Xj of Equation (1) is substituted as an input to the sigmoid func- 
tion of Equation (2) so as to output yj. 

n 

x j = Z w ij xx i (1) 
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y i =f(X i )s 1 + exp(-X j ) (2) 

[0068] In a well-learned neural network 61 . upon receiving the feature parameters P, through P 3 obtained in the char- 
acter region, Op. and 0 6 of the output layer respectively output values close to "1", "0", and "0". Similarly, upon 
receiving the feature parameters P, through P 3 obtained in the photographic region. O c , O p and O s of the output layer 
respectively output values close to "0", "1", and "0". Likewise, upon receiving the feattxe parameters P, through P 3 
obtained in the halftone dot region. O c , 0 Pi and O s of the output layer respectively output values close to "0\ "0" , and 
"V. t 

[0069] In the judging circuit 6a of Fig. 7, discrimination values, namely, values of Oaoo and Oa^ are determined in 
accordance with the values respectively obtained from O c . 0 Pi and O s of the output layer of the neural network 61 . For 
example, when O c takes the maximum value. Oa^ = 0 and Oa^ =0. and when O p takes the maximum value, Oaoo = 
0 and Oaoi = 1 . and when O s . takes the maximum value, Oaoo = 1 and Oaoi = 0. 

[0070] In the case of realizing the judging circuit 6a by a look-up table, the input-output characteristics of the neural 
network 61 are reflected in the look-up table. Specifically, a look-up table (not shown) is realized by a memory device 
such as RAM (Random Access Memory) or ROM (Read Only Memory). The memory device is provided with memory 
regions corresponding to combinations of the feature parameters P, through P 3 . and a discrimination value is stored in 
each memory region. 

[0071] The look-up table, upon receiving the feature parameters P, through P 3 . outputs the discrimination value 
stored referring to a memory region corresponding to the combination of the feature parameters P, through P 3 inputted. 
The discrimination values stored in the look-up table reflect the input-output characteristics of the neural network 61. 
For example, when the neural network 61 outputs a certain discrimination value in response to an input of a certain 
combination of the feature parameters P, through P 3 , the discrimination value is stored in a memory region correspond- 
ing to this combination of the feature parameters P n through P 3 . 

[0072] On the other hand, in the case of realizing the judging circuit 6a by the neural network 61 itself, the judging 
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circuit 6a is composed of. along with other members, the neural network 61 of Fig. 8 and an encoder (not shown) for 
encodmg the d.scr.mmat.on values from the values obtained from O c . O p . and O s of the output layer of the neural net- 

[0073J The following describes, as another example of the structure of the judging circuit 6 of Fig. 1. the case where 

lS™ na ! 0n informat,on J I"**** <* the likelih °od that the region including the target pixel is a character region a 
photographic region, or a halftone dot region is outputted. referring to Fig 10 

Z2L r^™ 1 * 38 °f? ° f *" iUd9in9 CirCUit 68 * Rg - 7 " a jud 9 ina circuit » in accordance with the present 
SSLSST ' nP "I J 00 10 > indiCatiVe 01 ** ,irSt feature Darameter Pi - inP"t signals l 10 to l 15 indicative of 
2l ?2£ S Parameter P 2 . and input signals to l 22 indicative of the third feature parameter P 3 However, the 
^Jutofthe judging crcurt 6b is different from that of the judging circuit 6a. Of the 8 bits of the output value ob 3 bits 
UJDoo jo Oboa) aro used as an output value i ndicative uf Uw li ke l i h ood of the character region, and 2 bits (Ob 10 and 

Obi 1 1 are used ae an nirtnuitiaiiiA ir^;^».\,~ ~< 1:1,-1:1 1 . w v '0 01 ,u 



Ob„) are used as an output value indicative of the likelihood of the photographic region, and 3 bits (Ob*, to Ob^) are 
used as an output value indicative of the likelihood of the halftone dot region ^ 

.. N ?jl!l a !: ,he *' tal number <* bits of the output value Ob and the number of bits allocated to each region type 
are not limited to the above example, and other values may be adopted. However, as shown in Fig. 2 through Fig 5 it 
is easier to judge the photographic region compared with the character region and the halftone dot region Thus in the 

^™ 6 ,f IS £ES t °^ UtdOWnthet0tal "V"* 3 " of bits of 0"tP"t value Ob. it is desirable that a less number 
or Dits are allocated to the photographic region compared with that to the other regions 

Jt!" 1" ^ 5B ^ e !f 9i " 9 drCUit the judg, ' n9 drcuit 66 030 be reafeed ^ the neural network 61 of Rg. 
, ' ° 3 l ° 0k " up teble ref 'retina the input-output characteristics of the neural network 61 . However, the judging 

ObSfSSST ,Ud9in9 d,CUit 63 ^ ° C ' 0p " ^ ° 8 ° f ' ayer correspond t«> the output *!lue 

, Specifically, in thejudging circuit 6b. the value obtained from O c of the output layer is converted into 3 bits so 
T ^°°J°P b0S ,n 1he lowing, the values of O boo to Ob^ will be referred to as Ob,. In the 
same manner the value obtained from Op of the output layer is converted to 2 bits so as to obtain a value Ob, of Ob 1D 
io uo 11 . ana the value obtained from O s of the output layer is converted to 3 bits so as to determine a value of OD3 of 

EITL^J!^ 16 mJn ? 6r 0f inpUt brtsforthe ' udain 9 circuit 6a and the judging circuit 6b is not limited to the num- 
bers mentioned above, so that it is possible to select an arbitrary number of bits depending on the use. However when 
tr^H mT! is J" creased - the judging accuracy is improved, lowering of processing speed and" a rise 
"» ,nd "~ d - Therefore, it is desirable to select an optimum number of bits considering these conditions. Also 
nn^I^L V* ^^ natwork is not limrte d to the one shown in Rg. 8. Namely, in the neural network, the number 
of intermediate layers and the number of neural elements of the intermediate layer are arbitrary, and it is possible to 
adopt a neural network having a different structure. 

J^l^Jr 0 ^'^-^^ 8 36078 Bxanypie ' when third feature parameter calculating circuit 5 of Rg. 1 calculates 
n~ fe 5 j ''! i P arameter p 3- the maximum succession equal density pixel number C1 is determined 

,Zi ry °^ 3nd drf,erences < CS C8 > between maximum values (C3 and C6) and minimum values (C4 

ana 07) of the maximum succession equal density pixel number C1 are calculated 

J^T* - ? C " T nUmber * ma5dmum succession equal density pixel number CI is not more than the 
r^Z^ST 3 l '"! d,r !f ti0n> the differences < C5 and C8) between the maximum values and the minimum values 
cannot exceed the number of pixels in a line direction. Here, since the third feature parameter P 3 is calculated as the 
♦T'T^" 6 ^! difterence 05 in the main scanni "9 direc «on and the difference C8 in the sub scanning direction, 
the value of the thrd feature parameter P 3 also cannot exceed the number of pixels in a line direction. 

« S»ntL " ^ ma T ner ' I" ^ Ca ' CU,ati0n method " ^ size of the third feature parameter P 3 is limited to not more 
JT^ er 01 01X6,8 each ,ine drection a >ocal block. As a result, the difference between the feature param- 
eter of the character region and the feature parameter of the halftone dot region becomes small with respect to the third 
feature parameter P 3 . and this might set a limit to the improvement of discrimination accuracy 
[0082J In contrast in a third feature parameter calculating circuit 5a which will be described in the follow,™, the third 

so L^IL^^n 3 18 Ca ! CU ?l! d « ba8ed 0,1 8 6Um 02 01 * e maximum «"Ocession equal density pixel number C1 of 
so succeeding plural lines instead of the maximum succession equal density pixel number C1 

l ^ t3 \ Specifically, as shown in Fig. 1. a main maximum pixel number calculating circuit 56a. which is provided 
instead of the .mam maximum pixel number calculating circuit 51a. calculates the maximum succession equal density 
pixel number C1 per main line, and calculates the sum C2 of plural main lines succeeding or succeedingl/arranged in 
55 of C2of tntlcS Uodfa^cT *" ptal number ^^ng circuit 56a outputs the maximum value 

t °? 8 1 1 . J? f an1p,e ' when a local ««* "as 7 main lines and the number of succeeding plural lines is 2 six C2 are 
calculated in the local block, and the maximum value of the six C2 is outputted as C3. In the same manner, a main min- 
imum pixel number calculating circuit 57a. which is provided instead of the main minimum pixel number calculating cir- 
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curt 52a, outputs a minimum value C4 of the six C2 in a local block. 

[00851 The same process is also carried out with respect to the sub scanning direction. A sub maximum pixel number 
calculating circuit 56b and a sub minimum pixel number calculating circuit 57b. which are provided instead of the sub 
maximum pixel number calculating drcuit 51band a sub minimum pixel number calculating circuit 52b respectively cal- 
culate the maximum succession equal density pixel number C1 per sub line, and determine the suni C2 of plural sub 
lines succeeding in the main scanning direction. The sub maximum pixel number calculating circuit 56b and the sub 
minimum pixel number calculating circuit 57b then respectively output a maximum value C6 and a minimum value C7 
of respective sums C2. 

[0086] Depending on the pixel resolution, there is a case where the thickness of a line of a character ora halftone dot 
exceeds two pixels. In such a case, between succeeding plural lines, the signal levels of pixels often result in the same 

' **" Not e t hat > ' " ca se wn ere an i m ag o g ' gna ' ® g e n e rat e d, for examp l e, b y sc a nni n y of a docu m ent by t he image 

reading section including the CCD image sensor, the pixel resolution is determined by the reading resolution 
[00871 In the described manner, by calculating the variable of the third feature parameter P 3 using the sums C2 of 
succeeding plural lines instead of the value of C1 of a single line, it is possible to increase the value of third feature 
is parameter P 3 while sufficiently representing the feature of the local block. In other words, the resolution of the third fea- 
ture parameter P 3 is improved. As a result, the difference between the feature parameter of the character region and 
the feature parameter of the halftone dot region is further increased with respect to the third feature parameter P, and 
the discrimination accuracy of the judging circuit 6 is improved. 

so [Second Embodiment] 
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[0088] In the image processing apparatus as described above, the explanations are given through the case where 
the second feature parameter calculating circuit 4 is provided with the main difference value calculating circuit 41a and 
the sub difference value calculating circuit 41b. and the sum of difference values is calculated with respect to each of 
25 the main scanning direction and the sub scanning direction. 

[0089] In contrast in the present embodiment two additional directions are provided for calculating the sum of differ- 
ence values. Specifically, as shown in Fig. 1 1 . in a second feature parameter calculating circuit 4a in accordance with 
the present embodiment, in addition to the structure of the second feature parameter calculating circuit 4 there are pro- 
vided a right diagonal 45° direction difference value sum calculating circuit (referred to as right diagonal difference value 
calcutetjng circuit hereinafter) 41c and a left diagonal 45° direction difference value sum calculating circuit (referred to 
as left diagonal difference value calculating circuit hereinafter) 41 d for calculating the sums of difference values with 
respect to a right diagonal 45° direction and a left diagonal 45° direction, respectively. The comparator 42 outputs as a 
variable of the second feature parameter P 2 , a minimum value of respective outputs of the difference value calculating 
circuits 41a through 41d. 

[0090] In the above arrangement, the edge component in the diagonal directions is detected by the right diagonal dif- 
ference value calculating circuit 41c and the left diagonal difference value calculating circuit 41d. Therefore even when 
the local block includes the edge component not only in the main scanning direction and the sub scanning direction but 
also in the diagonal directions, the variable of the second feature parameter P 2 is increased. As a result the discrimi- 
nation accuracy for the character region including an edge component in the diagonal direction is further improved 
[0091] Note that, in the present embodiment, as the diagonal directions, two directions of right diagonal 45" direction 
and left diagonal 45° direction are adopted; however, as long as the diagonal directions are different from the main 
scanning direction and the sub scanning direction, the number and the degree of slope of the diagonal directions are 
not limited. Nevertheless, when the right diagonal 45° direction and the left diagonal 45" direction are adopted as the 
diagonal directions, the directions of detecting the edge component are situated eventy. This allows the discrimination 
accuracy for the character region to be further improved. 

[Third Embodiment] 

[0092] In First and Second Embodiment, the explanations are given through the case where the image processing 
apparatus outputs region discrimination information of a region including each pixel. In contrast, in the present embod- 
iment explanations will be given through the case where the image processing apparatus further carries out a spacial 
r!™« pr ^ ess ^ an exam P»e of an image process which is earned out based on the region discrimination information 
[0033] Specifically, as shown in Fig. 12. in addition to the structure of Fig. 1 1 , the image processing apparatus in 
accordance with the present embodiment is further provided with a filtering process circuit (filtering means) 8 for sub- 
jecting an image signal to spacial filtering in accordance with the instruction from the judging circuit 6. Note that Fig 
1 2 shows a structure wherein the filtering process circuit 8 is additionally provided in the structure of Fig 1 1 However 
a similar effect can be obtained by additionally providing the filtering process circuit 8 in the structure of Fig. 1 
[0094] The following briefly describes the operation of the image processing apparatus having the above arrangement 
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referring to the flowchart of Fig. 1 3. In the present embodiment, after S4 of Fig. 6. a new step S5 is added As in Fin 6 

T*? 68 °! thrOU{,h fealure P 31 ™^ 8 p i trough P 3 are calculated with' respect to a 

local block having ttie target p.xel at the center, a discrimination process for the target pixel is carried out inS3 based 

° n «fl ^ , ?' the n6W 516,3 S5> *" fi,tering rsmcess circuit 8 chan 9 es *• f »ter to be used in accordance 
with the output value (region discrimination information determined in S4) of the judging circuit 6 so as to subject the 
image signal to a filtering process. 

"* S 2 toS5 ar * earned out co^^ compared with the case 

of setting a block beforehand, it is possible to improve the discrimination accuracy, and to carry out an optimum f ilterinq 
process in accordance with each target pixel. 

^L. 1 !! e -^ l ' tWin9 .! ri '.' describe in more detail filter coefficients used in the filtering process circuit 8 and a method 
of Setting the^rite^eoeffictent s. Tor e x a m p l e, a t, i n t h e udbe ut U . e judyi i i y uiuuit ba u f Fig. In the case of outoutbng 
the discrimination signal Oa. namely, when the judging circuit 6 selects that the target pixel exists in which of the char- 
acterregion. the photographic region, and the halftone dot region, a filtering process circuit 8a described below is used 
T!l~r£ eC ?.! •* discrimination signal Oa indicating that the target pixel exists in the character region is 

outputted. the filtering process circuit 8a subjects the image signal to an enhancement process using, for example an 
enhancement filter having filter coefficients as shown in Fig. 14. As a result, the edges of the image are enhanced and 
characters and line drawings appear sharper. When the discrimination signal Oa is indicating a halftone dot region the 
image signal is subjected to a smoothing process, for example, with a smoothing fitter having filter coefficients of Fig 
15. The filter coefficients are set so as to suppress the frequency component of the halftone dots. As a result moire is 
prevented from generating in the halftone dot region. When the discrimination signal Oa is indicating the photographic 
region, the image signal is outputted without being subjected to the filtering process. 

[0098] Note that, the f iKering process circuit 8a may have an arrangement wherein the smoothing filter and the 
enhancement filter respectively having the above filter coefficients are provided, and the two filters are switched in 
accordance with the discrimination signal Oa Also, when the filter processing circuit 8a can change the filter coeffi- 
C 'T** S 1" the Ca f e where tne ,iter Processing circuit 8a is realized by execution of a predetermined program by a 
CPU. the filter coefficients as selected in accordance with the discrimination signal Oa may be set When the filtering 
process circuit 8a can change the filter coefficients to be used for filtering of the image signal in accordance with the 
discrimination signal Oa. the same effect can be obtained. 

[0099] On the other hand, for example, in the judging circuit 6b of Fig. 10. as the filtering process circuit 8. a filterina 
process arcurt 8b which switches the filter coefficients in the manner described below is used. Namely, when the judg- 
ing arcurt 6b judges that the region including the target pixel is the character region, while the output value Ob, indica- 
tive of the likelihood of the character region becomes large, the output value Obg indicative of the likelihood of the 
photographic region and the output value Oba indicative of the likelihood of the halftone dot region become small The 
f .tiering process circuit 8b judges, when the output value Ob T is larger than a pre-set value and the output values Ob, 
and Oba are smaller than the pre-set value, that the region including the target pixel is the character region, and sub^ 
jects the image-signal to an enhancement process with an enhancement filter having the filter coefficients of Fig 1 4 As 
a result, the edges of the image are enhanced, and the characters and line drawings appear sharper 
[01 00] Also, when the judging circuit 6b discriminates the halftone dot region, namely, when the output value Ob, 
indicative of the likelihood of the halftone dot region is larger than the pre-set value and the output valuesOb. and Ob, 

fhfiT 8 " 6 ^ 3 " !H! ^t Set ValU6, ima9e si9nal is sub j ected to a smoothing process with a smoothing filler having 
he filter coefficients of Fig. 15. As a resuK. it is possible to prevent moire from generating in the halftone dot region of 
trie image. 

[0101] When the photographic region is discriminated, namely, when the output value Obg indicative of the likelihood 
of the photographic region is larger than the pre-set value and the output values Ob, and Ob 2 are smaller than the pre- 
set value, the filtering process circuit 8b outputs the image signal without carrying out the filtering process 
[0102] In addition, in the judging circuit 6b. when it is difficult to judge whether a region including the target pixel is the 
character region, the photographic region, or the hafftone dot region, namely, when misjudgment is likely, there will be 
no large difference among the output values Ob, through Oba indicative of the likelihoods of the character region the 
photographic region, and the halftone dot region, respectively. In such a case, the filtering process circuit 8b outputs the 
image signal without carrying out the filtering process. Alternatively, in such a case, the filtering process circuit 8b sub- 
jects the image signal to a filtering process using, for example, a filter having the filter coefficients of Rg 16 namely, 
with a filter having a combined function of enhancement and smoothing, m this manner, the filtering process circuit 8b 
discriminates the case where misjudgment is likely, and selects filter coefficients which reduce the adverse effect of 
misjudgment even when misjudgment occurs. As a result it is possible to prevent the image from being adversely 
affected by misjudgment. and the image is improved. Note that, the filter coefficients of Rg. 1 4 through Fig 16 are iust 

T rt ' S possible to a ,ilter navin 9 an arbitrary mask size and arbitrary filter coefficients 
[0103] Incidentally, the above descriptions are based on the case where the filter processing circuit 8 selects one of 
the filter coefficients which have been prepared beforehand, in accordance with the region discrimination information 
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so 



oulputted from the judging circuit 6. 

S W L H frT ^ i H ttie C8Se 0f ** iudgin9 circuit 6b of Fj 9- 10 - in the where the judging circuit 6 outoute the 

lEST V 6 ' ikelih00d ° f ^ re9i0n namel * when the discriminaton irStion^dtates 
the hkehhood of the character region, the photographic region, and the halftone dot region. respect^lyTSerina ora 

Z 0 ^? e ^ r,bed , be,0W if adopted as faterin9 process drcuit 8 - ™ s a »™ ^SSSSSSbTS- 

ned out by determining optimum filter coefficients for the target pixel. 

[01051 Specifically, in the filtering process circuit 8c. the weight coefficient W a of the enhancement filter anri tho 
coefficient W s of the smoothing filter are determined from the following Equations 13 SmZ m 9 

W e = g 1 (O c ) 



(3) 



w 8 = g 2 (O s ) 



oS O a?e a T m ; a,ue ,ndlcat,ve °» the likelihood °< ». halftone dot region, and the output values 

u c ana u 8 are normalized to have a value in a range of 0 to 1. 

[0107] Here, as an example. W 8 and W s are determined using the following Equation (5). 



9i(x) = g 2 (x) 



■I 



- lOx +11 2 0.2) 
0 (x<0.2) 



...(5) 



25 \Tr^LJ! y 8 SPa , C , ial f "! r f 1 With * e inputs 01 W - and W a. a Bering process is carried out with respect to an 

input image signal I as shown in the following Equation (6). and a processed value O is outputted 

0 = f 1 (W e .W 6 . I) 
so [0109] Here, as an exarnpleof the spacial filter 
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[0110] Note1hat."[] . rin Equation (7) indicates the convolution calculation of the operator "[]" and the image signal 

[01 1 1 ] In the described arrangement, the f iltering process circuit 8c adjusts the filter coefficients h a «»i «n th» r ~,;„„ 
domination information indicate of the likelihood of each region type As a i^SSSS^SS^ 

ZZ2!2?~ W,,h 4 ° ptimum ,Bter *» each target pixel, thus reading « KISSjjSSSS 

capable of improving the image quality with more certainty. pressing apparatus 

[0112] Further, in thefirtering process circuit 8c. in the case where the likelihood of each region type is substantially 
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the same, namely, when it is difficult to categorize the region including the target pixel to be any of the character region, 
the photographic region, and the halftone dot region, for example, the filter coefficients are adjusted to have a combined 
function of enhancement and smoothing. This prevents the image quality from being deteriorated by judgement error 
As a result, the quality of the image is further improved. 
5 [0113] Note that, the functions g 1 and g 2 in Equation (5) may be replaced with other functions, and it is possible to 
adopt an arbitrary mask size and arbitrary filter coefficients for the filter f t . When the filtering process circuit 8 changes 
the filter coefficients based on the region discrimination information indicative of the likelihood of each region type, the 
same effect as in the present embodiment can be obtained. 

[0114] Also, the image processing apparatuses in accordance with First through Third Embodiment have an arrange- 
10 ment wherein the first through third feature parameter calculating circuits 3. 4. and 5 (5a) are provided, and the judging 
e*rcuit6 (6a) output&aregtorTtti sc ri min ati o ii sig n a l fo i Ui s c ii i n inating the c l iaiacte r r eg i on, the photographic region, and 
the halftone dot region in accordance with the combination of feature parameters of the first through third feature 
parameters P, through P 3 . However, the arrangement is not limited to this. When the region discrimination signal is 
generated by the judging circuit 6 (6a) in accordance at least with the variable of the third feature parameter P, the 
is same effect can be obtained. ■ 
[01 1 5] For example, it is possible to have an arrangement wherein only the third feature parameter calculating circuit 
5 (5a) of the feature parameter calculating circuits 3. 4 (4a). 5 (5a) is provided, and the judging circuit 6 outputs the 
region discrimination signal in accordance with the variable of the third feature parameter P 3 . As mentioned above refer- 
ring to Fig. 2. the distribution of the halftone dot region tends to be small with respect to the third feature parameter P 3 
irrespective of the number of linos in the halftone dot region. Thus, by discriminating based only on the third feature 
parameter P 3 , as shown in Fig. 3 through Fig. 5. it is ensured that a region composed of coarse halftone dots and a 
region composed of small characters are distinguished. 

[0116] However, in the case of discriminating in accordance only with the variable of the third feature parameter P 3 
there is a case where a region composed of large characters is erroneously discriminated as the halftone dot region, or 
a region composed of fine halftone dots is erroneously discriminated as the character region. Thus, as in First through 
Third Embodiment, it is preferable to have an arrangement wherein either the first feature parameter calculating circuit 
3 or the second feature parameter calculating circuit 4 (4a) is provided, and the judging circuit 6 (6a) generates the 
region discrimination signal in accordance with the variable of the first feature parameter P, or the variables of the sec- 
ond feature parameter P 2 and the third feature parameter P 3 . This allows the discrimination accuracy of the imaqe 
30 processing apparatus to be further improved. 

[01 1 7] To describe in more detail, the third feature parameter P 3 is calculated in accordance with the image of a bina- 
nzed local block. Thus, when the contrast is low as in a region composed of fine halftone dots, there is a case where 
the same value is given to acflacent pixels due to binarization. Further, when a density slope exists in an image, in one 
portion of the local block, for example, in the upper half portion, all the pixels therein take one of the binary values and 
in the other portion of the local block, all the pixels therein take the other binary value. In such a case, despite that fact 
that the regiorrt^a halftone dot region, the third feature parameter P 3 is increased, and it becomes difficult to distinguish 
this region from the character region. 

[0118] In contrast, the first feature parameter P, decreases in a region having low contrast as in a region composed 
of f me halftone dots. Thus, as shown in Fig. 4. when the judging circuit 6 (6a) generates the region discrimination signal 
in accordance with a combination of the first and third feature parameters and P 3 . the character region and the half- 
tone dot region can be discriminated more accurately irrespective of the size of the halftone dot. 
[01 1 9] Similarly, the second feature parameter P 2 increases in a region in which a density change is frequent as in a 
region composed of fine halftone dots. Thus, as shown in Fig. 5. when the judging circuit 6 (6a) generates the region 
discnmination signal in accordance with a combination of the second and third feature parameters P 2 and P 3 the char- 
acter region and the halftone dot region can be discriminated more accurately irrespective of the size of the halftone 
dot 

[0120] Also, since the third feature parameter P 3 is calculated in accordance with the succession in the main scanning 
direction and the succession in the sub scanning direction, the possibility of erroneously discriminating characters hav- 
ing diagonal lines as the halftone dot region is relatively high. The occurrence of this error is increased as the size of 
characters is increased. Therefore, as in Second Embodiment, by proving the second feature parameter calculating cir- 
cuit 4a with the diagonal direction difference value calculating circuit 41 c (41d). it is further ensured that the region com- 
posed of large characters is not discriminated erroneously 

[0121] In addition, as mentioned above referring to Fig. 2 through Fig. 5, compared with the character region and the 
halftone dot region, in the photographic region, the variable of the first feature parameter P, and the variable of the sec- 
ond feature parameter P 2 tend to be small. Thus, when the judging circuit 6 (6a) generates the region discrimination 
signal in accordance with all combinations of the first through third feature parameters through P 3 it is possible to 
discriminate the character region, the photographic region, and the halftone dot region. 

[0122] Note that, in First through Third Embodiment, the explanations are based on the case where the image signal 
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is obtained by scanning of a document However, not limiting to this, for example, the image signal may be obtained at 
once as in the case of using a digital camera, or may be sent from a memory device or a communication device. The 
present invention is applicable as long as an image signal indicative of the image in which pixels having a plurality of 
density levels are arranged two-dimensionally is inputted to the image processing apparatus. 
[0123] However, in the present invention, because the variable of each of the first through third feature parameters 
through P 3 is calculated in accordance with the maximum density difference, complexity, and succession of a local block 
composed of neighboring pixels, the discrimination accuracy can be improved without referring to the image signals of 
distant pixels. Thus, even in the case where the image signals of neighboring pixels are given successively as in the 
case of the image signal obtained by scanning a document, it is not required to store the image signal of the target pixel 
until the image signals of distant pixels are given. Therefore, it is possible to discriminate the region represented by the 
troage^i gnal obta i n e d by scanning a document without r e qu i r i n g a larg e m emoryxapacityr 



[0124J Alternatively, in order to discriminate that the target pixel, which is one of the pixels constituting the image 
exists in which of different regions including the character region and the halftone dot region, the image processing 
apparatus in accordance with the present invention may have an arrangement including: 

(1) a block memory for storing local image data which indicates a local block composed of the target pixel and a 
plurality of pixels surrounding the target pixel; 

(2) succession feature parameter calculating means which includes the following (a) to (c); 

(a) a main direction calculating section for calculating, with respect to a binary image prepared by binarizing 
the pixels in a local block with a predetermined threshold value, the maximum value of the numbers of suc- 
ceeding pixels having equal value per main line along the main direction, and determining the sums of the cal- 
culated values per at least one main line succeeding in the sub direction so as to determine a difference of the 
maximum value and the minimum value of the sums, 

(b) a sub direction calculating section for calculating, with respect to the binary image, the maximum value of 
the numbers of succeeding pixels having equal value per sub line along the sub direction, and determining the 
sums of the calculated values per at least one sub line succeeding in the main direction so as to determine a 
difference of the maximum value and the minimum value of the sums, and 

(c) an output section for oulputting the maximum value of the outputs of the main direction calculating section 
and the sub direction calculating section, as a variable of the succession feature parameter; and 

(3) discriminating means for oulputting region discrimination information for discriminating that the region including 
the target pixel is which region type of the different regions. 

[0125] Also, the image processing apparatus in accordance with the present invention may include maximum density 
difference feature parameter calculating means for calculating the difference between the maximum value and the min- 
imum value of the signal levels of the entire pixels of the local block based on the local image data so as to give the 
calculated value as a variable of the maximum density difference feature parameter to the discriminating means. 
[0126J In this arrangement, the discriminating means generates the region discrimination information in accordance 
with the variable of the maximum density difference feature parameter and the variable of the succession feature 
parameter. In general, in the halftone dot region, the difference between the maximum value and the minimum value, 
namely, the variable of the maximum density difference feature parameter tends to be smaller than that in the character 
region, and this becomes prominent as the number of lines in the halftone dot region increases. However, the image 
processing apparatus of the present invention ensures that the halftone dot region having a small number of lines and 
the character region are discriminated using the succession feature parameter. As a result, in the image processing 
apparatus, it is ensured that the halftone dot region and the character region are discriminated regardless of the nurriber 
of lines, thus improving the discrimination accuracy. 

[01 27] Further, the image processing apparatus in accordance with the present invention may include complexity fea- 
ture parameter calculating means for. with respect to the local image data, (i) calculating a difference in signal level of 
two succeeding pixels in the main direction in the local block, (ii) determining the sum of differences in signal level in the 
local block, (Hi) determining the sum of differences in signal level with respect to pixels succeeding in the sub direction, 
and Ov) giving, as a variable of the complexity feature parameter, the minimum value of the sums in the main direction 
and in the sub direction to the discriminating means. 

[0128J In this arrangement, the discriminating means generates the region discrimination information in accordance 
with a combination of the variable of the complexity feature parameter and the variable of the succession feature param- 
eter. In general, in the halftone dot region, a density change between adjacent pixels is frequent compared with the 
character region, and the variable of the complexity feature parameter tends to be larger than that of the character 
region. This becomes prominent as the number of lines in the halftone dot region increases. However, the image 
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[0129] In the photographic region, the maximum density difference feature parameter and the cormtexiiv fc»*„ m 
parameter are smaller than that in the character region and the halftone dot ^ TJ^^^J^Z 
apparatus ,s provided with respective feature parameter calculating means for m^rnum^si? d^e^ £55? 
^^S^Z" discriminatn 9 ™™ generates the region discrimination IntomSS i 
combinations of the maximum density difference parameter, the complexity parameter and th e ™cIS 

^J^FS^™?** te ca P able of 9 enera «"9 *e region discretion in^^^JSS^SSS^■ 

rn f ffi c 2 ° C ^ araCtCr r e g i on a , 1 d Uie h al f to " « P l -u l uu.aphlc region discriminate. 

mert LSlrllTh^'T^? 06851 " 9 aPParatUS in accordance «*" present invention, in addition to the arrange- 
ment including the complexity feature parameter calculating means, may have an arranoement wh Jo£ IZlZZlT 

zz^t ■* f r ion ^ substen,ia " y ortho9onai to «* ^^^^s^^Z^^ 

means further calculates the sum of the differences in signal level with respect to diagonalSr^ 

[0131] With this arrangement, in the local block, the variable of the complexity feature parameter is in,™** 

^ mponent is inc,uded in the main direcKon and the sub ««*SS!S3^ 

•ncluded .n the diagonal directions. As a result, the discrimination accuracy for the chTractJ rSr^ hL^nZT!l! 
component in the diagonal directions is further improved. cnaracter region having the edge 

[01 32} Note that, the number and the degree of slope of the diagonal directions wrth resoect to the main Hir^™ « ^ 
the sub direction are not limited as long as the diagonal directions are directed dS«2S™ * ma.n direction and 
the sub direction. Hcwever.when the rShtdiagonaf^d^ 

r e ^fhi ^ Z^ r T ,er " beNV6en ^ «*» and halftone dot region is^educi anS S inaeasi 

Oir£T?' 5ir ^^.cter region and the halftone dot region are discriminated erroneously 

[0135] Generally, as the resolution of image is increased, the occurrence that the thickness of rharartarc ,• 
drawings exceeding two pixels is increased. In such a case, the maximum values ?ttS^5^oSS2SlSiE 
havmg equal density tend to be close between succeeding plural lines succeeding p,xels 

[0136] Thus, when the variable of the succession feature parameter is calculated with resoect to succeed™ m.. ra i 
ISZSEZS!? f 86 th6 VariaWe of 1,16 succession ParameteMs caTc^Xr^to a 
iaK^ 

S^SLS^r^ST "2 be inCreaSed " 8 reSU,t 1,16 Character re 9 ion and •» harftoneSt regtn «!. 

^ ^ ^ ^ * e accuracy of the image processinglparSJs 

ShlJo^lS^I^ * e dfec,osure <* Ja P anese Unexamined Patent publication No. 147860/1987 
SS^! ! 62-1*7860). when discriminating a region including the target pixel in accordance with variables of a 2u 
ralrty of feature parameters, a certain threshold value is set beforehand wrth respect to eacn^ ^^^^^1. 
HIT P TT n9 aPParatUS Cateaorizes the parameters by individualist™ 

the threshott value. When the feature parameters are categorized per each Lu£ZZ£!^J£Z^?? 
tore parameters are often categorized erroneously, ft is also difficult to set an t^te^ZZu^to-J* £" 

etersin^ed.andouto.tstheregiond.cH^ 

feature JrlnS^ * he 5 iSCn jri2 atin9 meanS discrimina "* regions mufti-dimensionally using a plurality of 

[01 40] Note that, the discriminating means selects the region type including the character region and the halftone dot 
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region by providing boundaries having non-linear characteristics in a multi-dimensional space having axes of the fea- 
ture parameters inputted. The boundaries are non-linear, and it is extremely difficult to represent the boundaries by 
equations beforehand. 

[0141 ] In contrast, the discriminating means in accordance with the present invention includes a learned neural net- 
work which outputs, for example, in response to input of variables of the feature parameters, region discrimination infor- 
mation corresponding to the inputted feature parameters. 

[0142] Generally, the neural network has plural inputs, and even when desired input-output characteristics are non- 
linear and cannot be represented by equations, by repetitive learning, the neural network can be adjusted to have 
desired input-output characteristics relatively easily As a result, compared with the case where the equations repre- 
senting the boundaries are specified beforehand, it is possible to realize significantly high accurate discriminating 

me ans with r ela t i v e-ease, !_ 

[0143] Note that, in particular, in the case where a high processing speed is demanded for the image processing 
apparatus, the discriminating means is provided with, instead of the neural network, a look-up table storing beforehand 
values indicative of region discrimination information in accordance with combinations of the feature parameters. The 
values stored in the look-up table are determined, for example, in accordance with the input-output characteristics of 
the neural network which has learned beforehand. In this arrangement, the values indicative of region discrimination 
information in accordance with the combinations of the feature parameters are stored beforehand in the look-up table. 
This allows the discriminating means to output the region discrimination information significantly rapidly in accordance 
with the combinations of feature parameters referring to the look-up table. As a result, the image processing apparatus 
can carry out a highly accurate discrimination process real time. 

[0144] Also, it is possible that the discriminating means calculates, per each type of the report, the probability that the 
target pixel exists, and outputs, as the region discrimination information, a value indicative of the likelihood of each type 
of the region, such as the likelihood of the character region and the likelihood of the halftone dot region. 
[0145] C Jote that, the likelihood of each region type can be calculated in numbers relatively accurately and with ease 
by using, for example, the neural network and a look-up table reflecting the input-output characteristics of the neural 
network. 

[0146] In this arrangement, the discriminating means outputs the degree of likelihood that the region including the 
target pixel is the character region or the halftone dot region. As a result, the discriminating means can send more del- 
icate instructions to means for processing an inputted image, for example, means for carrying out spacial filtering, which 
is provided on the following stage of the discriminating means. 

[0147] Therefore, the means provided on the following stage of the discriminating means can adjust various coeffi- 
cients irj accordance with the likelihood of each region type, and can carry out more delicate image processing in 
accordance with each pixel. Also, the means on the following stage of the discriminating means is capable of selecting 
a process for pixels which cannot be discriminated, such as a combined process of the enhancement process and 
smoothing process based on information that it is difficult to specify the region. As a result, it is possible to prevent dete- 
rioration oHraage due to discrimination error, thus realizing an image processing apparatus with higher mage quality. 
[0148] ft is also possible that the discriminating means selects the type of the region including the target pixel, and 
outputs, as the region discrimination information, a discrimination signal indicative of the selected region. 
[0149] In this arrangement since the discriminating means only selects the region type, compared with the case 
where a value indicative of region type is outputted, the circuit structure of the discriminating means is simplified. Also, 
the means on the following stage of the discriminating means selects the content of image processing in accordance 
with the discrimination signal. As a result an image processing apparatus capable of faster processing is realized. 
101 50] Incidentally, the image processing apparatus in accordance with the present invention may be further provided 
with filtering means for carrying out a spacial filtering process with respect to the target pixel in accordance with the 
45 region discrimination information. 

[01 51 ] With this arrangement, since the discriminating means has significantly high discriminating accuracy, the filter- 
ing means can subject each pixel to the spacial filtering process with optimum filter coefficients for each region type 
without considering the discrimination error. As a result, the image quality of the image outputted from the image 
processing apparatus can be improved. 

[01 52] Note that the filter coefficients of the filtering means can be set by various methods: For example, it is possible 
that the discriminating means selects the region type of the region including the target pixel, and outputs a discrimina- 
tion signal indicative of the selected region as the region discrimination information, and that the filtering means carries 
out a spacial f fltering process with fitter coefficients which are selected from predetermined filter coefficients in accord- 
ance with the discrimination signal. 

[01 53] However, in order to improve the image quality, it is preferable that the discriminating means calculates, per 
each region type, the probability that the target pixel exists, and outputs as the region discrimination information a value 
indicative of each region type of. for example, the character region and the halftone dot region, and the filtering means 
carries out a filtering process with filter coefficients which have been calculated in accordance with the value indicative 
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of each region type. 

[0154] With this arrangement, the filtering means can adjust the filter coefficients based on region discrimination infor- 
nation indicative of each region type. This enables delicate image processing in accordance with each target pixel 

S^J^L^^^J^T^ thS re9i0n inClUdin9 th6 terget P*^ to be any of the regions, for example, in 
the case where the likelihood of each region type is substantially the same, the filtering means can carry out a f ilterina 
process suitable for the pixels which cannot be discriminated, such as a filtering process with a combination of 

r e H,f» nC t IT ent ProCW L"? d /'If'" 9 Pr0CeSS - Thus ' deterioration <* ima 9« due to discrimination error is prevented. As a 
result, the image quality is further improved. 

! JUShJ? f 0 ?" 9 - med l Um aocoidance witn «» present invention records a program for calculating discrimination 
miTnt n nT minat,ng ? f ^ Plxel ' ^ is 0TO 01 ***** constituting an image, exists In which image 
o?ra n ""^y rog,on and a half tone dot "P * * "- aid ' """ d * a P'oa ' am t or carrying out the ta l lowing steps 



rnirei m-.~~i.. « . ~ . = ' ~" - ^"s""'" "-" vxuiymg oui ine lonowing steps. 

~52t Pr09ram J S for carry,n9 001 the ^ * t 1 ) ca'cu'a«ng. per main line along the main direction, with 

h r ?j^ a ,T ,ma9e Wh ' Ch haS t?een prepared ^ «*wrWhQ the pixels in the local block with a predetermined 
oTSi^t'S" 6 '. ^ * 106 nUmbers ° f **»«*ig »*■•« having equal value, and determining the sum 

of calculated values per at least one main line succeeding in the sub direction, so as to determine a difference of the 
max,mum value and the minimum value of the sums; (2) calculating, per sub line along the sub direction, with respect 
lum of « a ^, in ^? e ' T 6 maxim T va,ue 01 *» numbers « succeeding pixels having equal value, and determining*** 
fh™ 66 Vatu !f per at ,east ° ne sub line succeeding in the main direction, so as to determine a difference of 

f*"!?™* Rvalue and the minimum value of the sums; (3) calculating the maximum value of the differences deter- 

discnmination information of the region including the target pixel. 

E57 J^ 0 " exe !, ution 01 P r °9 r am. »ne region discrimination information of the region including the target pixel is 
cateuteted m accordance with the variable of the succession feature parameter. As a result, it is ensured that the naff 

r?m i nfL re9, ° n "^J!™" " *"* and *• d " ,n,c,,r re 9 ion are dominated, thereby improving the dis- 

crimination accuracy for the target pixel. 

£n™^ rt will be obvious that the same may be varied in many ways. Such varia- 

loufc hi r^n ^ ^* l*^* ^ ^ ^ and scope of the invention, and all such modificatons as 
would be obvious to one skilled in the art are intended to be included within the scope of the following claims. 

Claims 



1. 



2. 



3. 



An image processing apparatus, comprising: 

a main direction calculating section for calculating a first line maximum value, per main line along a predeter- 

^w^" J^T , With , [fff* t0 a binary image P re P ared ** binarizing with a predetermined threshold 
value image data of a local block composed of a target pixel, which is one of pixels constituting an image, and 
a pluralrty of p.xels surrounding the target pixel, the first line maximum value being a largest number of suc- 
ceedingly arranged pixels having an equal value in the predetermined main direction in the local block so as to 
determine a difference between a main maximum value which is the largest first line maximum value and a 
main minimum value which is the smallest first line maximum value; 

a sub direction calculating section for calculating a second line maximum value, per sub line along a sub direc- 
tion differentfrom the main direction, with respect to the binary image, the second line maximum value being 
a largest number of succeeding!? arranged pixels having an equal value in the sub direction so as to determine 
a difference between a sub maximum value which is the largest second line maximum value and a sub mini- 
mum value which is the smallest second line maximum value; 

an output section for outputting, as a variable of a succession feature parameter, larger of differences respec- 
tively outputted from said main direction calculating section and said sub direction calculating section- and 
discriminating means for outputting region discrimination information for discriminating that the target pixel 
exists in which region of different image types of the character region and the halftone dot region in accordance 
with an output of said output section. 

The image processing apparatus as set forth in claim 1 . wherein said main direction calculating section includes a 
sum calculating section for adding the first line maximum value per not less than two main lines so as to determine 
a sum of first line maximum values. 

The image processing apparatus as set forth in claim 1 . wherein said sub direction calculating section indudes a 
,sum calculating section for adding the second line maximum value per not less than two sub lines so as to deter- 
mine a sum of second line maximum values. 
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4. The image processing apparatus as set forth in claim 1 , further comprising: 

maximum density difference feature parameter calculating means for determining, with respect to all pixels in 
the local block, (i) a maximum value (Amax) and a minimum value (Amin) of an image signal representing the 
image and (ii) a difference (B) of the maximum value (Amax) and the minimum value (Amin) so as to give as 
a variable of a maximum density difference feature parameter, the difference (B) to said discriminating means. 

5. The .image processing apparatus as set forth in claim 1 , further comprising: 

complexity feature parameter calculating means for (i) sequentially calculating differences (C) of an image sig- 
'•eprosorrtin g the i mag e betwe e n t wo su cce e din g^ ai i d i i ye d pixe l s i n the m a i n d i i act i on In the l ocal block 
(i.) determining a sum (D) of the differences (C) calculated, (iii) determining a sum (E) of the differences (C) 
with respect to pixels succeeding in the sub direction, and (iv) determining a minimum value (Fmin) of the sum 
' ' and the < E )- so as to give, as a variable of a complexity feature parameter, the minimum value (Fmin) 
to said discriminating means. 

6. The image processing apparatus as set forth in claim 4. further comprising: 

complexity feature parameter calculating means for (i) sequentially calculating differences (C) of the image sig- 
nal representing the image between two succeedingly arranged pixels in the main direction in the local block 
(ii) determmmg a sum (D) of the differences (C) calculated, (iii) determining a sum (E) of the differences (C) 
wrth respect to pixels succeeding in the sub direction, and (iv) determining a minimum value (Fmin) of the sum 
' and the sum < E >- 90 as to Qive. as a variable of the complexity feature parameter, the minimum value (Fmin) 
to said discriminating means. 

7. The image processing apparatus as set forth in claim 5. wherein said complexity feature parameter calculating 
means includes a calculating section tor 0) determining a sum (G) of the differences (c) with respect to pixels suc- 
ceedingly arranged in a diagonal direction different from the main direction and the sub direction and (ii) determin- 
ing a minimum value (Hmin) of the sums (D). (E). and (G) so as to give, as a variable of the complexity feature 
parameter, the minimum value (Hmin) to said discriminating means. 

a The image processing apparatus as set forth in claim 7. wherein the main direction and the sub direction are sub- 
stantially orthogonal to each other. 

9. Theimage processing apparatus as set forth in claim 8. wherein the diagonal direction is inclined 45" with respect 
to themain direction and the sub direction. 

10. The image processing apparatus as set forth in claim 4. wherein said discriminating means includes a judging cir- 
cuit for dividing a multi-dimensional space having axes of feature parameters including the succession feature 
parameter and the maximum density difference feature parameter into regions respectively corresponding to the 
different image types by providing boundaries having non-linear characteristics in the multi-dimensional space so 
as to dscnminate a region to which the target pixel belongs from regions of different image types in accordance 
with respective variables of at least the succession feature parameter and the maximum density difference feature 
parameter. 

1 1 . The image processing apparatus as set forth in claim 6. wherein said discriminating means includes a judging cir- 
cuit for dividing a multi-dimensional space having axes of feature parameters including the succession feature 
parameter, the maximum density difference feature parameter, and the complexity feature parameter into regions 
respectively corresponding to the different image types by providing boundaries having non-linear characteristics 
injhe multidimensional space so as to discriminate a region to which the target pixel belongs from the regions of 
different image types in accordance with respective variables of at least the succession feature parameter, the max- 
imum density difference feature parameter, and the complexity feature parameter. 

12. The image processing apparatus as set forth in claim 10. wherein the judging circuit includes a neural network 
which has learned beforehand for outputting. in response to input of the respective variables of the succession fea- 
ture parameter and the maximum density difference feature parameter, the region discrimination information in 
accordance with the respective variables. 
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13 " ^tSlo rOC l S f^ T!^ 5 95 S6t forth daim 11 ' wherein 1,16 » ud 9 in 9 includes a neural network 
which has learned beforehand for outputting. in response input of the respective variables of the succession feature 
parameter, the mawmum density difference feature parameter, and the complexity feature parameter the region 
disCTimination information in accordance with the respective variables. ' 

14. The irmge processing apparatus as set forth in claim 10. wherein the judging circuit includes a look-up table 
whose input-output characteristics are predetermined by a neural network, for outputting. in response to input of 
the respective vanables of the succession feature parameter and the maximum density difference feature parame- 
ter, the region discrimination information in accordance with the respective variables. 

15. The image processing appar a t us as set form m c l aim n. wherein the judging circuit includes a look-up table 
v^oseinput-output characteristics are predetermined by a neural network, for outputting. in response input of the 
respective variables of the succession feature parameter, the maximum density difference feature parameter and 
the complexity feature parameter, the region discrimination information in accordance with the respective variables. 

The image processing apparatus as set forth in claim 4. wherein said discriminating means includes a judging cir- 
ki ea 5i* nB 3 Va ' Ue indiC3tive «* Prcbabi"'* «* an image type of the local block in accordance with respective 
vanables of the succession feature parameter and the maximum density difference feature parameter. 

The image processing apparatus as set forth in claim 6. wherein said discriminating means includes a judging cir- 
cuit for calculating a value indicative probability of an image type of the local block in accordance with respective 
vanables of the succession feature parameter, the maximum density difference feature parameter, and the com- 
plexity feature parameter. 

1a The imageprocessi ig apparatus as set forth in claim 1 . wherein said discriminating means includes a judging cir- 
curt for outputting. as the region discrimination information, an discrimination signal indicative of an image region 
including the target pixel. 

1 9. The image processing apparatus as set forth in claim 1 . further comprising: 

filtering means for carrying out a filtering process with respect to the target pixel in accordance with the region 
discrimination infVirmation. 

2a The image processing apparatus as set forth in claim 19. wherein said discriminating means includes a judging cir- 

^ir^— ?!^^i i n accordance *• variable - a indicative of probability that the target pixel exists in one 
ot tne regions of different image types. 

said filtering means carrying out a spacial filtering process with filter coefficients calculated in accordance with 
the value indicative of probability. 

21. The imageprocessing apparatus as set forth in claim 19. wherein said filtering means includes a tillering process 
circuit for changing the filter coefficients in accordance with the regions of differert image tyrjes based on the region 
discrimination information. a 

22. The image processing apparatus as set forth in claim 21 . wherein said filtering means includes a filtering process 
circuit for selecting, in a case where the discriminating means has a difficulty in judging that the target pixel exists 
m which region of different image types, filter coefficients having a combined filtering function for the regions of dif- 
ferent image types. 

23. The image processing apparatus as set forth in claim 1 . further comprising: 

a block memory for storing the image data of the local block, said block memory provided on a preceding stage 
of said main direction calculating section and said sub direction calculating section. 

24. The image processing apparatus as set forth in claim 1 . wherein in a case where a photographic region is included 
in the regions of drHerent image types, in a number of bits of data representing the region discrimination informa- 

^ T^ er ° for tne P" 0 **"*** region is set to be smaller than a number of bits for the character region 
and the halftone dot region. 
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25. The image processing apparatus as set forth in claim 1 , wherein said image processing apparatus is a diartal cod- 
ying machine. K 

26 ' See pr ° CeSSing a PP aralU8 35 set forth in daim 1 > herein said image processing apparatus is a facsimile 

27. The image processing apparatus as set forth in claim 1 . wherein said image processing apparatus is a digital cam- 

era. 

28 * C ° mP : Ut !r re ! d ^ b ' e recordi n 9 medium recording a program which calculates region d iscrimination information for 
thata ia.geip.xe., which is one of pixels constituting an .mage, exists in which of regions including a 
character region and a halftone dot region, said computer-readable recording medium recording a program for car- 
rying out image processing which includes the steps of: 

(1) calculating a first Hne maximum value, per main line along a predetermined main direction, with respect to 
a binary image prepared by binarizing with a predetermined threshold value image data of a local block com- 
posed of a target pixel and a plurality of pixels surrounding the target pixel, the first line maximum value being 
a largest number of succeeding!/ arranged pixels having an equal value in the predetermined main direction 
in the local block so as to determine a difference between a main maximum value which is the largest first fine 
maximum value and a main minimum value which is the smallest first line maximum value- 
rs) calculating a second line maximum value, per sub line along a sub direction different from the main direc- 
tion, with respect to the binary image, the second line maximum value being a largest number of succeedingly 
arranged pixels having an equal value in the sub direction so as to determine a difference between a sub max- 
imum value wrnch is the largest second line maximum value and a sub minimum value which is the smallest 
second line maximum value; 

(3) calculating, as a variable of the succession feature parameter, larger of differences respectively determined 
in said step (1) and in said step (2): and 

(4) generating the region discrimination information in accordance with the succession feature parameter. 
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